COMPUTATIONAL PROOF OF THE MACKEY FORMULA FOR q > 2 
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Abstract. Let G be a connected reductive group defined over a finite field with q ele- 
ments. We prove that the Mackey formula for the Lusztig induction and restriction holds 
in G whenever q > 2 or G does not have a component of type E. 

Let G be a connected reductive group defined over an algebraic closure F of a finite 
field of characteristic p > and let F : G — > G be a Frobenius endomorphism endowing 
G with an W q -structure, where q is a power of p and W q is the finite subfield of F of car- 
dinal q. By the Mackey formula for Lusztig induction and restriction, we mean the following 
formula 



gx?M,q) * r lcp oR mcq— Lj R Ln«McmsQ ° * R Ln«McPn«M ° ( a dg)M- 

£ e L F V5" G ( L,M ) f / M f 



Here, P and Q are two parabolic subgroups of G, L and M are F-stable Levi com- 
plements of P and Q respectively, Kp cP and *Rlcp denote respectively the Lusztig 
induction and restriction maps, (adg)M is the map between class functions on M F and 
SM F induced by conjugacy by g, and S^q (L, M) is the set of elements g € G such that L 
and #M have a common maximal torus. 

It is conjectured that the Mackey formula always holds. This paper is a contribution 
towards a solution to this conjecture. Our aim is to prove the last two lines of the 
following theorem: 

Theorem. Assume that one of the following holds: 

(1) P and Q are F-stable (Deligne Theorem 2.5]). 

(2) L or M is a maximal torus ofG (Deligne and Lusztig [9, Theorem 7]). 

(3) q > 2. 

(4) G does not contain an F-stable quasi-simple component of type 2 E(„ E7 or Eg. 
Then the Mackey formula (~-#g,l,p,m,q) holds. 

While the proofs of (1) and (2) work in full generality and are pretty elegant, our 
proof of (3) and (4) is as ugly as possible. It follows an induction argument suggested 
by Deligne and Lusztig [8. Proof of Theorems 6.8 and 6.9] (and improved in [1] and |2]) 
that shows that if the semisimple elements of G F satisfy some strange properties (see 
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Proposition 12. 1 1 for the list of properties) then the Mackey formula holds: then, checking 
Proposition 12.11 in cases (3) and (4) of the above theorem is done by a case-by-case 
analysis together with computer calculations using the CHEVIE package (in GAP3). 

Even when a proof of some important result requires a case-by-case analysis, one 
might expect to get some interesting intermediate mathematical results: this is not even 
the case in this paper. The interest of this paper is of two kinds: the result (not its 
proof) and the development of the CHEVIE package for computing with (semisimple 
elements of) algebraic groups. This extension of the CHEVIE package, together with 
some application to our problems, is presented in an appendix at the end of this paper. 

Remark - In fact, our proof shows that, if the Mackey formula (^g,l,p,m,q) holds 
whenever (G,F) is the semisimple and simply-connected group of type 2 Eg(2) and M 
is of type A2 x A2, then the Mackey formula holds in general (see Remark |3.9| |. □ 

1. Notation, recollection 

Algebraic groups. We fix a prime number p, an algebraic closure F of the finite field 
with p elements F p , a power q of p and a connected reductive group G (over F) endowed 
with an Fq -structure determined by a Frobenius endomorphism F : G — >■ G (here, F^ 
denotes the subfield of F with q elements). We also fix a pair (G*,F*) dual to (G, F) 
and we denote by n : G* — >• G* the simply-connected covering of the derived subgroup 
of G*. Then there exists a unique F ? -Frobenius endomorphism F* : G* -4 G* such that 
tc is defined over F«. 

In this paper, if H is an algebraic group, we denote by H° its neutral component. 
If U denotes the unipotent radical of H, a Levi complement of H is a subgroup L of H 
such that H = L x U. We shall define a Levi subgroup of G to be a Levi complement of 
some parabolic subgroup of G. The centre of H will be denoted by Z(H) and we set 
3T(H) = Z(H)/Z(H)°. lige H, the order of g will be denoted by (g) . 

If L is a Levi subgroup of G, then the morphism : 3f(G) — > 3f(L) is surjective 
(see lilOl Lemma 1.4]) and its kernel has been completely computed in [3. Proposition 
2.8 and Table 2.17]). If M is another Levi subgroup of G, we denote by S^g{L, M) the 
set of elements g G G such that L and #M have a common maximal torus. Recall that 
this implies that L n #M is a Levi complement of L D g Q, as well as a Levi complement 

of p n «m. 

If Z is an F-stable subgroup of the centre Z(G) of G, we also fix a pair ((G/Z)*,F*) 
dual to (G/Z, F) and we denote by jtz : G* -4 (G/Z)* the induced morphism: note 
that it is defined over F ? . There exists a unique morphism Tz : (G/Z)* -4 G* such that 
tc = Tz o Tiz'- it is also defined over Fn. Finally, we set Z* = Ker nz'- it is an F*-stable 
subgroup of Z(G*), which should not be confused with a dual (in any sense) of Z. 

We also recall the following definition: 
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Definition 1.1. A semisimple element s G G* is said to be isolated (respectively quasi- 
isolated) if its connected centralizer Cq« (s) (respectively its centralizer Cq* (s)) is not contained 
in a proper Levi subgroup of G. 



Class functions. We fix a prime number I ^ p and we denote by an algebraic closure 
of the ^-adic field Q(. If T is a finite group, the Q^-vector space of class functions r — > Qe 
is denoted by Class(r). This vector space is endowed with the canonical scalar product 
(, )r, for which the set of irreducible characters Irr T of T is an orthonormal basis. 

If L is an F-stable Levi complement of a parabolic subgroup P of G, let Rlcp ■ 
Class(L F ) — > Class(G F ) and *K L * cP : Class(G F ) — > Class(L F ) denote respectively the 
Lusztig induction and restriction maps. They are adjoint with respect to the scalar 
products (, )i/ and (,}qf. If g G G F , we denote by (adg)i : Class(L F ) — > Class(#L F ), 
A^(SA:l^A(g-Hg)). 

If s G G F is a semisimple element and if / S Class (G F ), we define 

dff: C° G (s) F — ► Q e 

J f{su) if u is unipotent, 
1 otherwise. 

Note that dff G Class(CQ(s) F ), so that we have defined a Q^-linear map 

df : Class(G F ) — > Class(C^(s) F ). 



Tori over finite fields. If S is a torus defined over F ?/ we denote by X(S) (respectively 
Y(S)) the lattice of rational characters S — > F x (respectively of one-parameter subgroups 
F x — > S). Let (, )s : X(S) x Y(S) — > Z denote the canonical perfect pairing. 

If moreover S is defined over Fn, with corresponding Frobenius endomorphism F : 
S — >• S, then there exists a unique automorphism (p : Y(S) -4 Y(S) of finite order such 
that F(A) = cj<p(A) for all A G Y(S). The characteristic polynomial of cp will be denoted 
by xs,f- since (p has finite order, xs,f is a product of cyclotomic polynomials. Note that 

(1.2) deg^ s ,F = dimS 
and that [11. Proposition 13.7 (ii)] 

(1.3) S F ~ Y(S)/(F - Id Y(s) )(Y(S)) and |S F | = X s,M- 

If m is a non-zero natural number, we denote by O,,, the m-th cyclotomic polynomial. 
We shall recall here the notions of <E> m -torus, as defined in (7[ Definition 3.2]: 

Definition 1.4 (Broue-Malle-Michel). We say that (S, F) is a <& m -torus if the characteristic 
polynomial of <p is a power of<t> m . 

If S' is an F-stable subtorus ofS, we say that (S',F) is a Sylow <£> m -subtorus of (S, F) if 
Xs',f is exactly the highest power of<t> m dividing Xs,f- 
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Recall Theorem 3.4 (1)] that there always exists a Sylow O m -subtorus, that it is 
unique and that, if (S, F) is itself a O m -torus (with xs,f = ^m)/ then Proposition 3.3 



It follows from the definition that (S, F) is a Oi -torus if and only if (S, F) is a split torus. 

Lemma 1.6. If dimS = 2, f/ien S F is isomorphic to one of the following groups 

(Z/( (? -l)Z) 2 / Z/(?-l)ZxZ/(^ + l)Z ( (Z/((7 + l)Z) 2 , 

Z/((? 2 -l)Z, Z/((j 2 + ^ + l)Z or Z/((? 2 -q + l)Z. 

Proof. Since the only cyclotomic polynomials of degree ^ 2 are <3>i, 2 , O3 and <&6, it 
follows from [L2l that (S,F) is a <5,„-torus for m G {1,2,3,6} or that Xs,f = ^>i^>2- In the 
first case, the result follows from 11.51 

So let us examine now the case where xs,f = So <p 2 = Idy(s)- For m G {1,2}, 

let S m denote the Sylow O m -subtorus of S and let A m be a generator of Y(S m ) = {A G 
Y(S) I O W (0)(A) = 0}. So (Ax, A 2 ) is a basis of Q <8> z Y(S). Note that Y(S)/Y(S m ) is 
torsion-free. Two cases may occur: 

• If (Ai,A 2 ) is a Z-basis of Y(S). Then S ~ Si x S 2 and S F ~ S[ x Sf ~ Z/(q - 
1)Z x Z/(<f + l)Z. 

• If (Ai, A 2 ) is not a basis of Y(S), let A = (Ai + A 2 )/2 G Q <g>z Y(S) and let u = 
(p(A) = (Ai - A 2 )/2 GQ0z Y(S). First of all, let us show that A G Y(S). Indeed, there 
exists a and b in Q such that 770 = floAi + fcoA 2 G Y(S) and (flo/^o) ^ Z x Z. Since 
m + <P(.yo) G Y(Si) and // - </>(//o) G Y ( S )' we S et that 2fl o G Z and 2b G Z. By 
replacing flo and f>o by flo — a 'o and f>o — ^0 with bo, b' G Z, we may (and we will) assume 
that a , b G {0,1/2}. But M/2 G" Y(S) and A 2 /2 G" Y(S). So (a 0/ b ) = (1/2,1/2). So 
A G Y(S). 

Similarly, p = <^>(A) G Y(S). Now, if rj G Y(S), then there exists a, b G Z such that 
r/ + (p(n) = aX\ and 7/ — <£(r/) = bA 2 . Therefore, r\ = (a\\ + bA 2 )/2 = (a + fc)A + (a — b)p. 
So (A, p.) is a Z-basis of Y(S). In this basis, the matrix representing F is 



(3)] 



(1.5) 



S F ~ (Z/O m ( 9 )Z) r . 




It then follows from Q3] that S F 



is cyclic of order o 2 — 1. 



□ 
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2. A PROPERTY OF QUASI-ISOLATED SEMISIMPLE ELEMENTS 

The aim of this section is to prove the following proposition, from which the Mackey 
formula in the cases (3) and (4) of the Theorem will be deduced. 

Proposition 2.1. Let M be an F-stable Levi complement of a parabolic subgroup Q ofG. Assume 
that the quadruple (G,F, M, Q) satisfies all of the following conditions: 

(PI) G is semisimple and simply-connected and F permutes transitively the quasi-simple 
components of G; 

(P2) The quasi-simple components ofG are not of type A; 

(P3) M is not a maximal torus ofG and M / G; 

(P4) There exists an F-stable unipotent class of M which supports an F-stable cuspidal local 
system; 

(P5) Q is not contained in an F-stable proper parabolic subgroup ofG; 

(P6) For every F-stable subgroup Z of Z(G) n Z(M)°, there exists a semisimple element 
s e (M/Z)* F * which is quasi-isolated in (M/Z)* and (G/Z)* and such that, for every 
z G 7r z (G* F *) n Z((M/Z)*) F \ s and sz are conjugate in (G/Z)* F *. 
Then G is quasi-simple, the pair (G,F) is of type 2 E(„ q = 2 and M is of type A2 x A2. 

The rest of this section is devoted to the proof of this proposition. This will be 
done through a case-by-base analysis, relying on some computer calculation using the 
CHEVIE package (in GAP3). Before starting the case-by-case analysis, we gather some 
consequences of properties (Pk), 1 ^ k ^ 6, that hold in all groups. 

So, from now on, and until the end of this section |2j we fix an F-stable Levi comple- 
ment M of a parabolic subgroup Q of G such that the quadruple (G, F, M, Q) satisfies 
the statements (PI), (P2), (P3), (P4), (P5) and (P6) of the Proposition ED Using (PI), let 
us write 

G = Go x • • • x Go, 
v „ ' 

d times 

where Go is a semisimple, simply-connected and quasi-simple group defined over F_d 
and F permutes transitively the quasi-simple components of G. In particular, F stabi- 
lizes Go and G F ~ Gq . Let Mo denote the F d -stable Levi subgroup of Go such that 
M = M x F M x • ■ • x F<,_1 Mo. We denote by n : Gq -¥ Gq the restriction of n to the 
first component. 
We write 

G* f* v v C* C** C** v ^ C** 

— Vjq A A vjq, Vjr — Vjq A ' • A Vjq 

V v ' V „ ' 

d times d times 

M* = Mq x F *M^ x • • • x ^Mq, 

M* = 7r- a (M*) and M* = ^(MJ). 

IfZcZ(G )nZ(M )°is F rf -stable, we set Z = Z x F Z x • • • x ^Z, S z = Z((M/Z)*) oF \ 
S' z = Sz n 7Tz(Z(M*) oF ), ez = |Sz|/|S z | and we denote by s z a semisimple element 
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of (M/Z)* F * which is quasi-isolated in (M/Z)* and (G/Z)* and such that, for every 
z G S' z , Szz and Sz are conjugate in (G/Z)* F *. Note that such an element exists by (P6). 
If Z = 1, we set sz = s, Sz = S, S' z = S' and ez = e for simplification. We denote by 
So the projection of s on the first component Go of G. Recall that Z* is the kernel of rcz- 
we denote by Zq the projection of Z* on the first component Gg. 

Note that, if Z = Z(G ) (which might happen only if Z(G ) C Z(M )°), then Z = 
Z(G), (G/Z)* = G*, Z* = 1 and 5Tz(G ) is the identity. Then: 

Lemma 2.2. The properties (Pk), 1 ^ ft: ^ 6, have the following consequences: 

(a) There exists an F d -stable unipotent class of Mo which supports an F d -stable cuspidal 
local system. 

(b) Z(M)° is not an F-split torus (for the action ofF). 

(c) e z = \H l (F*,Z* nKerft|*J| = \H l {F* d ,Zl D Kerfc^)|. In particular, e z(Go) = 1 

flndex = |H x (F* d ,Ker/z2,)|. 

(d) Sz contains an element of order ^ max(^ d — l,q + 1). 

(e) AZZ f/ze elements of S'z have order dividing the order ofsz- 

(f) J/M z's o/fype B, C or D, f/ien p ^ 2. 

(g) J/dimZ(M f ) = 1, fen S z z's isomorphic to Z/(q d - 1)Z or Z/(q d + 1)Z. 

(h) 7/ r dimZ(Mg) = 2, f/zen Sz z's isomorphic to one of the following groups 

(Z/( (? rf -l)Z) 2 , Z/(/-l)ZxZ/(/ + l)Z, (Z/(^ + l)Z) 2 , 

Z/(q 2d -l)Z, Z/(q 2d + q d + 1)Z or X/ (q 2d - q d + 

Proof of lemma \2.2\ (a) follows immediately from (P4). (b) follows from (P5) and the 
following well-known result: 

Lemma 2.3. Let P be a parabolic subgroup of G and let L be a Levi complement of P. 
Assume that L z's F-stable and that Z(L)° z's F-split. Then P z's F-stable. 

Proof of Lemma PZ3l Let T be an F-stable maximal torus of L. Let <J> C X(T) 
denote the root system of G with respect to T. If a £ <J>, we denote by U a the 
associated one-parameter unipotent subgroup. If A 6 Y(T), we denote by P(A) 
the subgroup of G generated by T and the U«'s such that (a, A) ^ 0. Then P(A) 
is a parabolic subgroup and F(P(A)) = P(F(A)). 

Since P is a parabolic subgroup of G admitting L as a Levi complement, there 
exists A e Y(Z(L)°) C Y(T) such that P = P(A). Now, F(P) = P(F(A)) and 
F(A) = q\ because F is split on Z(L)°. So F(P) = P, as expected. □ 

(c) Let K = Ker 7r z n Z(M*)° = Z* n Ker h^ t . From the natural exact sequence 1 — » 
K — > Z(M*)° — > Z((M/Z)*)° — > 1, we deduce an exact sequence of cohomology groups 

1 — >K F * — ► Z(M*)° r -4 Z((M/Z)*) oF * — > H^F^K) — ► H X (F*, Z(M*)°) = 1. 

The first equality in (c) then follows immediately. The second is straightforward. 
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(d) Note that <P m (q) ^ q - 1 ^ 1 if m ^ 1 and O m (^) ^ ^ + 1 ^ 3 if m ^ 2 (note, how- 
ever, that 6 (2) = 2 (2) = 3). Let S z = Z((M /Z)*)°. We have S z ^ S%*. Since 
M/G, we have that dim S z ^ 1. So there exists m ^ 1 such that O m divides Xs Z/ F* d - By 
11.51 there exists an element of S z of order <& m {q d ) ^ q d — 1. 

lid ^2, then q d -l^ q + \. l£ d = 1, then (S z , F*) is not split by (b), so there exists 
m ^ 2 such that <5 m divides 7Cs z ,f* • So, again by 11.51 there exists an element of S z of 
order 3? m (q) ^ q + 1. 

(e) Let z € S z . Let d denote the order of s z . Since s z z and s z are conjugate in (G/Z)*, 
we have (s z z) c? = 1. But s z z = zs z and s| = 1, so z rf = 1. 

(f) Assume that M is of type B, C or D and that p = 2. Then Z(M) = Z(M)° and 
Z(M*) = Z(M*)°. So Z(G) CZ(M)°. Therefore, by |1 Example 4.8], s z(Go) is central in 
M*. Moreover, S z(Go) = S z(Go) by (c), and s z(Go) G S z(Go) . So, by Lemma O (d), there 
exists an element z of S Z( - Gq ^ different from 1. If s Z( - Go ) = 1, then s Z ( Go ) and s Z( - Go )Z are 
not conjugate in G* F *, contradicting (P6). If s z(Go) ^ 1, then s z(Go) and s z(Go) s z( 1 Go) = 1 
are not conjugate in G* F , contradicting again (P6). 

(g) follows from II .51 and (h) follows from Lemma lL6l □ 

We can now start our case-by-case analysis, that will be done as a long sequence of 
lemmas. 

Lemma FG. The group Go is not of type F4 or G2. 

Proof of Lemma FG. Assume first that Go is of type G2. Then by Lemma [22] (a) and [12, 
§15.5], we get that Mo = Go or that Mo is a torus. This contradicts (P3). 

Assume now that Go is of type F4. Then by Lemma IZ2l (a) and |12] §15.4], we get that 
Mo = Go or that Mo is a torus or that p = 2 and Mo is of type B2. This contradicts (P3) 
and Lemma [22] (f). □ 

Lemma BCD2. If Go is of type B, C or D, then p > 2. 

Proof of Lemma BCD2. Assume that G is of type B, C or D and that p = 2. Then s = 1 
(see [4, Example 4.8]), e = 1 (since Z(G*) = 1), and, if z denotes an element of S = 
S' different from 1 (such an element exists by Lemma 12.21 (d)), then s and sz are not 
conjugate in G* F . □ □ 



Lemma C. The group Go is not of type C. 
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Proof of Lemma C. Assume that Go is of type C„ with n ^ 2. Note that p 7^ 2 by Lemma 
BCD2 (so q ^ 3). Since G*> is a special orthogonal group, we have o(s) = 1 or 2 (see 
(H Proposition 4.11]). Moreover, since |Z(G*)| = 2, we have e ^ 2 by Lemma 12.21 (c). 
Therefore, if S contains a non-trivial element z of odd order, then z G S' and s and sz 
are not conjugate in G*. This shows that every element of S is a 2-element. 

On the other hand, if S contains a non-trivial element z of order greater than or equal 
to 8, then z 2 G S' and o(z 2 ) ^ 4 > 2. So s and sz 2 are not conjugate in G*, contradicting 
(P6). So, every element of S has order 1, 2 or 4. In particular, by Lemma |Z2] (d), we get 
that d = 1 and q = 3, so G = Sp 2)3 (F). In particular, G is split. 

By (P4) and by H2 §10.4], we have G* ~ S0 2n+ i(F) and M* ~ S0 2m +i(F) x (F x ) r 
with n = m + r and r ^ 1. Note that Z(M*) = (F x ) r . Since every element of S has 
order 1, 2 or 4, this means that F* acts on M* (through the previous isomorphism) via 
the following formula : 

F*(Mi t r ) = (F»,tf' t^) 

for every a G S02 m +i(F) and tj G F x . Here, £y G {1,-1}. Moreover, by Lemma |Z21 
(d), S contains at least one element of order 4, so there exists j such that tj = —1. Let i 
denote a fourth root of unity in F x . Then 

z= (Id, 1,..., 1 i 1,... ,1) G S0 2m+1 (F) x (F X ) ! '~M* 



position 

is an element of S. In particular, z 2 G S' (since e ^ 2). Let us write s = (s', ^1, . . . , €E 

M* F * with s' G S0 2m +i(F) and & G F x . Since s 2 = 1, we have s' 2 = 1 and l] = 1. It is 

now easy to check that s and sz 2 are not conjugate in G*. □ 

Lemma SO. There does not exist a subgroup Z of Z(Go) H Z(Mo)° such that Go/Z ~ 
SO N (F) /or some N ^ 7. 

Proof of Lemma SO. Assume that Go — Spinjv(F), with N ^ 7, and that there exists a 
subgroup Z of Z(G ) n Z(M )° such that G /Z ~ SO N (F). Note that p ^ 3 by Lemma 
BCD2. Then, by (P3), by Lemma O (a) and by [12, §§10.6 and 14], we have Z = 
Z(Mo)° fl Z(Go). In particular, Z is F rf -stable. Then (Go/Z)* is a special orthogonal or 
a symplectic group. Thus, s| = 1 by Hi Example 4.10 and Proposition 4.11]. Moreover, 
by (121 §10.6] and |3j Table 2.17], ez = 1. Therefore, S' z contains an element z of order 
greater than or equal to q + 1 ^ 4. So Sz and Szz are not conjugate in (G/Z)*. This 
contradicts (P6). □ 



Corollary D4. The group Go is not of type D4. 
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Proof of Corollary D4. Assume that Go is of type D4. Then, by (P3), by Lemma IZ2l (a) 
and by JTH §§10.6 and 14], we have that M is of type A 1 x A x . Now, let Z = Z(G ) n 
Z(Mo)°. Then |Z| = 2 and (Go/Z)* is a special orthogonal group. This is impossible 
by Lemma SO. □ 

Lemma BD. The group Go is not of type B or D. 

Proof of Lemma BD. Assume that Go — Spin^(F). By Lemma BCD2, we have p ^ 3. 
Moreover, by (P2) and by Lemma C (and since Spinw(F) ~ Sp4(F), we have that 
N ^ 7. Let n denote the rank of Go- We have n = [N/2]. Then Go is of type 0„, with 

G {B, D}. By Lemma |Z2l (a), by Lemma SO and by US §§10.6 and 14], M is of type 

<0„, x (A 1 )'" with m ^ and n = m + 2r. 

Note that N ^ 8 by Lemma D4, that e ^ 2, and that s 4 = 1 (see [4, Table 2]). So, 
by (P6), every element of S has order dividing 8. By Lemma 12.21 (d), this implies that 
d G {1,2} and q G {3,7}. Assume first that d = 2. Then necessarily q = 3 (by Lemma 
E2](d)) and S ~ (Z/8Z) r . If r ^ 2, then S' contains an element z of order 8 (because S' 
has index at most 2 in S) and s and sz are not conjugate in G*: this contradicts (P6). So 
r = 1, but then e = 1 so S = S' contains an element of order 8: this contradicts again 
(P6). Therefore, d = 1, G = G and M = M and q G {3,7}. 

Let Z be the subgroup of Z(G) of order 2 such that G/Z ~ SOn(F). Then Z is F- 
stable. Write G = G/Z and M = M/Z and let s be an element of G* such that Tz(s) = s. 
Then, by [4, Table 2 and Proposition 5.5 (a)], s 4 = 1. Moreover, M* ~ H x (GL 2 (F)) r , 
where H ~ Sp 2m (F) if = B and H ~ S0 2m (F) if = D. 

Write s = (§', t\, . . . , t r ) where s' G H and f, G GL 2 (F). Since s is quasi-isolated in G, 
the eigenvalues of t{, which are fourth roots of unity, satisfy G {1,-1}. 

Now, F* permutes the r factors GL 2 (F). Assume that F* has an orbit of length greater 
than or equal to 3. Then S contains an element of order greater than or equal to 3 3 — 1, 
which is impossible. Now let S denote the center of a product of GL 2 (F) factors which 
are in the same orbit (we denote by / the length of this orbit: we have I G {1,2}). Let S 
denote the torus of G* such that 7r z (S) = S and let S = t z (S). Since I ^ 2 and n 7^ 8, 
the map n : S — > S is an isomorphism of groups. Note that S C Z(M)°, so S f ~ 
7r(S F ) C S'. But, if / = 2, then S F * contains an element of order greater than or equal to 
8 so S' contains an element of order greater than or equal to 8. This contradicts (P6). If 

1 = 1, let z denote an element of S F * of order 4. Let i G {1,2, ... ,r} denote the place of 
the GL 2 (F) factor we are considering. Write S7iz(z) = (§', t\,..., t\, tj + i, ...,t r ) and 
let li and £■ denote the eigenvalues of t\. Since G {1, -1}, we have {&,£■} ^ {Ci/Cf} 
so s and sn{z) are not conjugate in G*. This contradicts again (P6). □ 

Before going on our investigation of the remaining cases (types Eg, E7 and Eg), we 
introduce the following property of the quadruple (Go, Mo, Z,n), where Z is a subgroup 
of Z(Gq) n Z(Mq)° and n is a non-zero natural number. 
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{^G Mo,z,n) Ifs is a semisimple element of (Mo/Z)* which is quasi-isolated in (Mo/Z)* and 
in (Go/Z)*, then there exists an element z € Z((Mo/Z)*)° of order dividing n such 
that s and sz are not conjugate in (Go/Z)*. 

The property («5*G ,Mo,Z,n) does not always hold (for instance, ^g ,m 0/ z,i never holds) but 
it can be tested with an algorithm using the CHEVIE package: this will be explained in 
the appendix. In the appendix, we will also present some examples for which property 
(S fi G ,Mo,z,n) holds (see Lemma lATTj) and that will be used in the proof of the next lemmas 
(we will also give non-trivial examples in which (^G ,M ,z,f!) does not hold). 

Lemma E6. If Go is of type Eg, then q = 2, d = 1, M = Mo is of type A 2 x A2 and (G, F) is 
not split. 

Proof of Lemma E6. We assume in this subsection, and only in this subsection, that Go is 
of type E6- Then, by Lemma IZ2l (a) and by [12, §15.1], this implies that we are in one of 
the following cases: 

• Mo is a maximal torus. 

• Mo is of type D4 and p = 2. 

• M is of type A 2 x A 2 , p ^ 3 

• M = G . 

By (P3), the first and the last cases are excluded. By Lemma 12.21 (f), the second case is 
excluded. So M is of type A 2 x A 2 and p ^ 3. Note that Jf (M ) ~ Z/3Z ~ 3T(G ) 
(see [3, Table 2.17]) and that the graph automorphism of Go acts non trivially on ^(Go). 
So e = 1 (by Lemma IZ2l Ccn and, if we denote by e G {1, — 1} the element defined by the 
condition e = 1 if and only if the graph automorphism of Go induced by F d is trivial, 
then F d acts on Jf(Mo) — Z/3Z by multiplication by tq d . But, if we denote by x tne 
linear character of (Mo) associated with the cuspidal local system on Mo, then % is 
faithful [12, §15.1] and F rf -stable, so eq = 1 mod 3. We can summarize these facts in the 
following statement: 

(Eg 1 - 1 ) Mo is of type A 2 x A 2 , p ^ 3, e = 1 and eq d = 1 mod 3. 

In particular, it follows from (P6) that 

(2) 

(Eg ) So is quasi-isolated in Gq and Mq and sq is G^-conjugate to Soz for all 
z € Z(M*) oF * d . 
This implies that 

(Eg 3 - 1 ) The order of so divides 6. 

(Eg 4 - 1 ) All elements o/Z(Mg) oF have order dividing 6. 

(Eg 5 '') Z(MQ) oF " d does not contain all elements of order 3 o/Z(Mq)°. 

Indeed, (E^ 3) ) follows from [4, Table 3], (E^ 4) ) follows from (E^ 3) ) and Lemma E3 (e), 
while (e[ 5 ^) follows from the fact that (^g ,m ,i,3) holds (see Lemma [AT] (1)), which is 
proved by computer calculation in the Appendix A. 
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Now, by Lemma E2(d) and (E^ 4 ) ), we get that q d < 7 and 9 ^ 5. Recall also that p ^ 3 
by (E^). So 

(E< 6) ) 77ie/w belongs to {(2,1), (4,1), (5,1), (2,2)}. 

Moreover, dimZ(M^)° = 2. If q d = 4, then Lemma 1221 (h) and (E^ 4) ) force that 
Z(M*) oF * d ~ Z/3Z x Z/3Z, so Z(M*) oF * 1 ' contains all elements of order 3 of Z(M*)°. 
This contradicts (E^). 

Similarly if q d = 5, then Lemma E2j(h) and (E^ 4) ) forces that /(Mq) ^ ~ Z/6Z x 
Z/6Z, so Z(MQ) oF * d contains all elements of order 3 of Z(Mq)°. Again, this contradicts 
(E^). Therefore q = 2 and d = 1: in particular, e = —1 by (E^). 

(Eg 7 - 1 ) q = 2, d = 1 and the pair (G,F) is not split. 

So Lemma E6 follows from (Eg ) and (E^). □ 

Lemma E7. The group Go is not of type E7. 

Proof of Lemma E7. We assume in this subsection, and only in this subsection, that Go 
is of type E7. Then, by (4), the group Mo admits an F d -stable cuspidal local system 
supported by a unipotent class. By |T2l §15.1], this implies that we are in one of the 
following cases: 

• Mo is a maximal torus. 

• Mo is of type Ai x Ai x Ai, ker h^ Q = 1, and p ^ 2. 

• Mo is of type D4 and p = 2. 

• Mo is of type E(, and p = 3. 

• M = G . 

By (P3), the first and the last cases are excluded. By Lemma 12.21 (f), the third case is 
excluded. We will now investigate the two remaining cases. 

• Assume first that Mo is of type Eg and that p = 3. By |3. Table 2.17], we get that 
3T(Mo) = 1 so Z(G ) C Z(M )°. Now, (G /Z(G ))* = G* , so s z(Go) is isolated in Gq\ 
in particular, its order belongs to {1,2,3,4}. So it follows from Lemma 1221 (c) and (d) 
that q d ^ 3. So q = 3 and d = 1. Since dimZ(M*)° = 1 and since Z(M*)° is not split by 
Lemma |22](b) and (g), this forces S Z ( Go ) ~ Z/4Z. So S' Z( ^ G ^ = S Z ( Go j contains all the 
elements of Z(M*)° of order dividing 4. But then Lemma lA.ll (21 contradicts (P6). So 
this case cannot occur. 

• So assume now that M is of type Ai x Ai x A lr that Ker = 1 and that p 7^ 2. 
Note that these conditions describe completely the type of the pair (Go, Mo). Indeed, it 
is given by the following diagram, where the three black nodes correspond to the simple 
roots of Go which are simple roots of Mq: 
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o 



o 




o 



(E 7 [A?p) 



By 112, §15.2] and © Table 2.17], we get that e = 1. By @ Table 3], o(s) G {1,2,3,4,6}. 
So it follows from Lemma 12.21 (c) and (d) that q d ^7 and q ^ 5. Moreover, since p > 2, 
we get: 

(E^) d = e = 1 and q G {3,5}. 
Moreover, by Lemma IA. II (3). we get that (=^g ,m 0/ i,4) and (^g ,m ,i,6) hold, so 

(E^) Z(Mg) oF " does nof contain all elements of order 4 of Z(Mq)°. 

(Ey 2 - 1 ) Z(Mg) oF " does nof contain all elements of order 6 o/Z(Mg)°. 
Since o(s) G {1,2,3,4,6}, we get that 

(E^ 3) ) Every element ofZ(M* ) oF * has order in {1,2,3,4,6}. 

For simplification, let x = Xz(m*)°,f*- H /£ contains some factor O m with m ^ 3, then it 
follows from Lemma |L5l that Sz contains an element of order Q? m (q) ^ ^E > m(3) ^ ^6(3) = 
7, so this contradicts (E^ 3) ). Since dimZ(M^) = 4, % = $>?3>!' with « + & = 4. If a, & > 1, 
then it follows from Lemma [A.2I of the Appendix that Z(Mq) oF contains an element of 
order ^ 8, which is impossible by (E^). Moreover b ^ by Lemma 12721 (b). So ^ = 0|. 
But then (Z(M^)°,F*) is a 2 -torus. It then follows from O that 



Lemma E8. The group Go is not of type E$. 

Proof of Lemma E8. First, note that Go is simply-connected and adjoint, so e = 1. It then 
follows from (P6) that 



(E^) 1 ^o(so) <6. 

(Ef } ) All the elements ofZ(M*) oF * d have order in {1,2,3,4,5,6}. 

Indeed, (eJ 1} ) follows from H Proposition 4.9], (E^ 2) ) follows from (E^) and (P6). 
Moreover, by Lemma IZ2l (a) and [12, §15.3], we are in one of the following cases: 



• M = G . 

By (P3), the first and the last cases are excluded. By Lemma 12.21 (f), the second case is 
excluded. We will investigate the two remaining cases. 



S z * (Z/(q + l)Z) 4 . 

(2) (2 f ) 

Since q G {3,5}, this contradicts (Ej, ) and (Ey ). 



□ 



• Mq is a maximal torus. 



• Mo is of type D4 and p = 2. 

• Mo is of type Eg and p = 3. 

• Mq is of type E7 and p = 2. 
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• Assume first that Mo is of type Eg and that p = 3. Then, since (^GaMoAz) holds by 
Lemma IA.1I (5), it follows that 

(e£ 3) ) Z(M,5) oF * d does not contain all elements of order 2 o/Z(Mj$)°. 

By Lemma 12.21 (c), (Eg 2 ^) forces q d ^ 7. Since p = 3, we get that q = 3 and d = 1. 
Moreover, since dimZ(M*)° = 2, we get that Z(M*) oF is isomorphic to one of the 
following groups 

Z/2Z x Z/2Z, Z/2Z x Z/4Z, Z/4Z x Z/4Z, 

Z/(3 2 -l)Z = Z/8Z, Z/0 3 (3)Z = Z/13Z or Z/<D 6 (3)Z = Z/7Z. 
But this contradicts the fact that (Eg 2 } ) and (E^) both hold. 

• Assume now that Mo is of type E7 and that p = 2. It then follows from Lemma IA.1I 
(4) that 

(Eg 4 - 1 ) Z(Mg) oF '" i does not contain all elements of order 3 o/Z(MJ)°. 
(Eg 4 - 1 ) Z(Mq) oF '"' does not contain all elements of order 5 of Z(Mq)°. 

By Lemma O (c), (E^ 2) ) forces q d sC 7. Since p = 2, this implies that q d G {2,4}. But 
dimZ(M,5) = 1, so Z(M^) oF * is isomorphic to one of the following groups 

Z/((7 rf -l)Z or Z/(q d + l)Z. 

In other words, Z(Mq) oF *'' is isomorphic to Z/3Z or Z/5Z. This contradicts (Eg 4 " 1 ) or 
(Eg 4 ')). ' ' □ 



Now, the proof of the Proposition 12. 1 1 is complete by (P2) and the Lemmas C, BD, FG, 
E6, E7 and E8. 



3. Application to the Mackey formula for Lusztig induction and restriction 

This section is devoted to the proof of the main result of this paper, namely the 
Theorem stated in the introduction. We shall fix some notation: if L and M are respective 
F-stable Levi complements of parabolic subgroups P and Q of G, we set 

^Lc p,m c Q = *^Lc p ^m cq~ ^lrsm c LrVQ ° *^Ln*M c Pn*M ( a d <?)m- 

gGL F \,r G (L,M) f /M F 

The Mackey formula (^g^p^lq) is then equivalent to the equality 

(•^g,l,p,m,q) a lcp,mcQ = °- 
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3.A. Preliminaries. First, note that 

(3.1) / = if and only ifdff = Ofor all semisimple elements s G G F . 

We now recall some results from Q: these are some properties of the maps A g cPMc q 
which can be proved a priori (see |2f). 
First of all 

(3.2) A G cP mcQ an d ^McQ lcp are adjoint for the scalar products (, ) l f and (, ) m f. 

Let P' and Q' be parabolic subgroups of G and let L' and M' be the unique Levi com- 
plement of P' and Q': we assume that L' and M' are F-stable and that L C L', P C P', 
M C M' and QcQ'. Then |2j Proposition 1 (c) of the Corrigenda] 

A G — *R L ' oA G o R M ' 

"LCP,MCQ ~~ iv LcPfU' u ^L'cP',M'cQ' McQDM' 

+ y *rl' r l' 

^ L-i LcPnL' ° \'nsM'cL'n«Q' 

gGL' F Yy G (L',M')/M' f 

( 3 - 3 ) ° A Lrii'M'cP'ni'M',i'McS(QnM') ° ( ad #)M 

v L ' 

'LcPnL',L'n?McL'nxQ 



+ E A i' 



geL' f \,y G (L',M) f /M f 
° R LWMcWM°( a ^)M' 

Also, if s G L F is semisimple, then [2, 5.1.5] 

(3.4) E 1^&A§W CC . (S) s) o^ o(ad?)M . 

such that sG&M 

In particular, if z G Z(G) F , then [2, 5.1.6] 

(3.5) d\ o A G cP mcQ = ^lcp,mcQ ° d™ '• 

Finally, if G denotes a connected reductive group endowed with an F^-Frobenius en- 
domorphism (still denoted by F) and if z : G — > G is a morphism of algebraic groups 
defined over IF^ and such that Ker i is central in G and Im i contains the derived sub- 
group of G, then [5, Proposition 1.1] 

( 3 - 6 ) ° A LCP,MCQ = A tcP,McQ ° ^ • 

Here, ? = z'-^?) for ? G {L,P,M,Q} and Resj^ : Class(L F ) -4 Class(L F ), / t-> foi. In 
this last situation, we shall need the following lemma: 



Lemma 3.7. If Ker i C Z(G)° and if u and v are two unipotent elements ofG F , then u and v 
are conjugate in G F if and only ifi{u) and i{v) are conjugate in G F . 
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Proof. Of course, if u and v are conjugate in G F , then i(u) and i(v) are conjugate in G F . 
Conversely, assume that i(u) and i(v) are conjugate in G F . Then there exists g G G such 
that i(g) G G F and i{gug~ l ) = i(v). So there exists z G Kerf such that gug^ 1 = zv. 
Since u and u are unipotent, this forces z = 1. So gwg -1 = f • 

On the other hand, as G G F , we get that g^F(g) G Kerz C Z(G)°. By Lang's 
Theorem, there exists z D G Z(G)° such that z a F(z^ 1 ) = g^ 1 F(g). Then z D g G G F and 
(z ^) M (z g)- 1 = V. □ 



3.B. Main Theorem. We are now ready to prove the Theorem announced in the intro- 
duction: 

Theorem 3.8. Assume that one of the following holds: 

(1) P and Q are F-stable (Deligne |13J Theorem 2.5]). 

(2) L or M is a maximal torus of G (Deligne and Lusztig [9, Theorem 7]). 

(3) q > 2. 

(4) G does not contain an F-stable quasi-simple component of type 2 E6, E7 or E$. 
Then the Mackey formula Al cPMc q = holds. 

Proof. For simplification, we will denote by (PO) the following assertion on G: 

(PO) q > 2 or G does not contain an F-stable quasi-simple component of type 2 Eg, E7 or E$. 

In other words, (PO) is equivalent to say that G satisfies at least one of the assertions (3) 
or (4) of the Theorem |3.8l 

Our proof of Theorem 13.81 follows an induction argument. We denote by ^(G) the 
order of the torsion group of Y(T)/ (O v ), where T is a maximal torus of G and O v C 
Y(T) is its coroot system. We set 

n G , L ,M = (dimG,dimL + dimM,^(G)) G N x N x N. 

We shall denote by ^ the lexicographic order on IN x N x N and we assume that we 
have found a sextuple (G, F, L, P, M, Q) which satisfies (PO) and such that Ap cP Mc q ^ 
with nc,L,M is minimal (for the lexicographic order =4). Our aim is to show that 
(G,F,L,P) or (G, F, M, Q) satisfies all the properties (Pk), 1 < k < 6. Then we get a 
contradiction, since Proposition 12. 1 1 shows that there is no quadruple (G, F, M, Q) satis- 
fying (PO), (PI), (P2), (P3), (P4), (P5) and (P6) together. 

For this purpose, we shall need the following trivial remark, that will allow to use an 
induction argument: 

(IND) If G satisfies (PO) and if H z's a connected reductive subgroup of G of the 
same rank, then H satisfies also (PO). 
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• First step: proof of (P5). Assume that P and Q are contained in proper F-stable 
parabolic subgroups P' and Q' respectively. Let L' (respectively M') be the unique Levi 
complement of P' (respectively Q') containing L (respectively M). Then V and M' are 
F-stable by uniqueness and AfcP' M'cQ' = by Theorem 13.81 (1). So it follows from the 
minimality of n^nj, from 13.31 and from (IND) that A^ cP Mc q = 0, contrarily to our 
hypothesis. 

Therefore, P or Q is not contained in a proper F-stable parabolic subgroup of G. By 
13.21 we have also that A^ c q LcP ^ 0, so we may assume that Q is not contained in a 
proper F-stable parabolic subgroup of G. 

Therefore, from now on, we will prove that (G, F, M, Q) satisfies all of the properties 
(Pk), 1 < k ^ 6. We have just proved (P5). 

• Second step: proof of (P3). This follows immediately from Theorem |3.8l (2). 

• Third step: proof of (PI). Let u G Class(G F ) be such that Al cPMc q(^) ^ and 
let s G L F be semisimple. By the minimality of dimG and by (IND), it follows from 
El that df o A£- P McQ = if s g Z(G) F . So, byHZQ there exists z € Z(G) F such that 
d\ (Al cP/McQ (h)) 0- Therefore, A^ cP /McQ (d^V) = by|33] In other words, if we 
replace ]i by u, this means that we may (and we will) assume that \i has support on 
unipotent elements of M F . 

Now, let i : G — > G be the simply-connected covering of the derived subgroup of 
G and let F : G — > G denote the unique F^-Frobenius endomorphism such that i is 
defined over F ? . Let ? = i~ l {7), for ? G {L, P, M, Q}. Since p. has unipotent support, 
^lcpmcq(^) nas a ^ so a unipotent support. Moreover, since i induces a bijective mor- 
phism between the unipotent varieties, it induces a bijection between unipotent elements 
of G F and unipotent elements of G F . Therefore, Res£ f ^lcpmcq(^) ^ ^ - By 13-61 this 
means that iCicQ ^ ®' n GLM^ n G,L,M/ with equality if and only if i is an 
isomorphism. By the minimality of nc,L,M/ w e get that i is an isomorphism. So G is 
semisimple and simply-connected. 

By writing G as the product of its quasi-simple components, one can write G as 
a direct product of semisimple simply-connected F-stable groups Gj, j G / (/ being 
some indexing set), the Frobenius endomorphism acting transitively on the quasi-simple 
components of Gj. Since Lusztig functors are compatible with direct products, the 
minimality of nG,L,M implies that G is one of these G/s. Therefore, G is semisimple and 
simply-connected, and F permutes transitively the quasi-simple components of G. This 
completes the proof of (PI). 

• Fourth step: proof of (P2). This follows immediately from |2j Theorem 5.2.1]. 

• Fifth step: proof of (P4). Recall that we have found a class function u on M F , with 
unipotent support, and such that Al" cPMc q(^) ^ ®- Class un i(G F ) denotes the sub- 
space of Class(G F ) consisting of functions with unipotent support. In other words, 
Class un i(G F ) is the image of df. 
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Let £m denote the subspace of Class un i(M F ) generated by all the RjyJ'cQ'^')' where 
M' is an F-stable Levi complement of a proper parabolic subgroup Q' of M and y! G 
Class un i(M /F ). Then it follows from the minimality of nc,L,M/ from (IND) and from 
13.31 (see also (2j 5.1.8 and Proposition 1 (a) of the Corrigenda] for a particular form of 
this formula) that Al cPMc q(<Sm) = 0- So, if we write u = u c + fi', with y! G £m and 
Uc G &m, then Al cP/Mc q(^) = Al cPMc q(^ c ) ^ 0. This means that the vector space 
$yi is non-zero and that we may assume that ]i = }i c . But <fjyj- is the space of absolutely 
cuspidal functions on M F with unipotent support (as defined in [2, §3.1]: it was denoted by 
Cus un i(M F ) in this paper). 

Now, by the minimality of iig,l,M/ it follows that the Mackey formula holds in M (in the 
sense of [2, Definition 1.4.2]). So it follows from [2, Corollary 8 of the Corrigenda] that 
there exists an F-stable unipotent class of M which supports a cuspidal local system. 
This shows (P4). 

• Sixth step: proof of (P6). Now, let Z be an F-stable subgroup of Z(M)° n Z(G). 
Note that Z is finite (since G is semisimple). Let G = G/Z. If ? G {L, P, M, Q}, we 
set ? =? PI G. Note that dimG = dimG and dim! + dimM = dimL + dimM. Let 
t : G — > G denote the canonical morphism. Let u and v be two unipotent elements 
of M F . Since Z C Z(M)°, u and v are conjugate in M F if and only if r(u) and r(v) are 
conjugate in M (see Lemma ISTTll . So there exists a unique / G Class(G ) such that 
f = df Res^ /. Moreover, since Z C Z(M)° and by 1531 and 1551 

4ResgoAg c?;Mc Q(/) = A<f cPMcQ (/). 

So Ay p W _ (/) ^ 0. In particular, there exists an irreducible character u of M F such 

that A^ c p Mc q( j m) 7^ 0. Let s G M* F be semisimple and such that u G £ (M F , [s] M » F *)- 
By the argument in [l] Lemmas 5.1.3 and 5.1.4], and by the minimality of (dim G, dim L + 
dimM) = (dimG, dimL + dimM) G N x N (where N x N is ordered lexicographi- 
cally), s is quasi-isolated in M and in G. Moreover, by the argument at the end of the 
proof of [1, Theorem 5. 1.1], s is conjugate to sz (in G*) for every z G Z(M*) F * n 7r|(G* F *), 
where 7t* z : G* -> G is the simply connected covering of G . So we have proved 
(P6). □ 

Remark 3.9 - In fact, our proof shows that, if we are able to prove the Mackey formula 
(^g,l,p,m,q) whenever (G, F) is semisimple and simply-connected of type 2 Eg, q = 2 
and M is of type A2 x A2, then the Mackey formula would hold for any pair (G, F), 
where G is a connected reductive algebraic group and F : G — > G is a Frobenius 
endomorphism. 

Actually it can be shown that the problem reduces to prove that the scalar product 
(R^r^ 1 , R^r^ 1 ) has the value predicted by the Mackey formula, where £ is a faithful 
character of H l {F, Z(M)) and is the corresponding Mellin transform of a Gelfand- 
Graev character (see [2, Theorem 6.2.1]). We were unfortunately unable to do this. □ 
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A. Appendix: computations with semisimple elements using CHEVIE 



In this Appendix, we present briefly some algorithms and some programs using the 
CHEVIE package for computing with semisimple elements in reductive groups. We also 
present some applications that were used in the proof of Proposition 12.11 (see Lemmas 
E6, E7 and E8). 

Let S be a torus defined over F. The map F x ®x ^(S) —> S given by x ® A i— >• A(x) 
is an isomorphism, where we identify S to the group of its points over F. Thus, if we 
choose an isomorphism F x ~ (Q/Z) p /, we get an isomorphism (Q/Z) p / <S>z Y(S) — > S. 
Thus, if dim S = r, an element of S can be represented by an element of (Q/Z) r as soon 
as we choose a basis of Y(S). 

If S is a subtorus of T, then the inclusion S C T is determined by giving a basis of 
the sublattice Y(S) inside Y(T). These are the basic ideas used to represent semi-simple 
elements in CHEVIE. 

A.A. Representing reductive groups. A reductive group G over F is determined up to 
isomorphism by the root datum (X(T),<£>, Y(T),<I> V ) where <I> C X(T) are the roots with 
respect to the maximal torus T and O v C Y(T) are the corresponding coroots. This 
determines the Weyl group, a finite reflection group W C GL(Y(T)). 

In CHEVIE, to specify G, we give an integral matrix R whose lines represent the simple 
roots in terms of a basis of X(T), and an integral matrix R v whose lines represent the 
simple coroots in terms of a basis of Y(T). It is assumed that the bases of X(T) and 
Y(T) are chosen such that the canonical pairing is given by (x,y)j = x;y,. 

For convenience, two particular cases are implemented in CHEVIE where the user just 
has to specify the Coxeter type of the Weyl group W. If G is adjoint then R is the 
identity matrix and R v is the Cartan matrix of the root system given by {& v (fi)}a,p 
where a v (resp. /6) runs over the simple coroots (resp. simple roots). If G is semi-simple 
simply connected, then G* is adjoint thus the situation is reversed: R v is the identity 
matrix and R the Cartan matrix. In all cases, the function we use constructs a particular 
integral representation of a Coxeter group, so it is called CoxeterGroup. 

By default, the adjoint group is returned. To illustrate this, the group PGL3 is obtained 

by' 

gap> PGL:=CoxeterGroup("A" ,2) ; 
CoxeterGroup ("A" ,2) 
gap> PGL . simpleRoots ; 

[[1,0], [0,1]] 
gap> PGL . simpleCoroots ; 

[ [ 2, -1 ] , [-1,2]] 

To get the semi-simple simply connected group, the additional parameter "sc" has to 
be given. For instance, SL3 is obtained by 

gap> SL:=CoxeterGroup("A" ,2, "sc") ; 
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CoxeterGroupC'A" ,2, "sc") 
gap> SL.simpleRoots; 
[ [ 2, -1 ] , [-1,2]] 
gap> SL . simpleCoroots ; 
[[1,0], [0,1]] 

To get GL3 we must use the general form by giving R and R v : 

gap> GL := CoxeterGroup( [[-1, 1, 0], [0, -1, 1]], 
> [ [ -1, 1, 0] , [ 0, -1, 1 ] ] ); 

CoxeterGroup([ [ -1, 1, ], [ 0, -1 , 1 ] ] , [ [ -1 , 1 , ] , [ 0, -1, 1 ] ]) 
gap> GL . simpleRoots ; 
[[-1,1,0], [0,-1,1]] 
gap> GL . simpleCoroots ; 
[[-1,1,0], [0,-1,1]] 

More features of CHEVIE will be illustrated when describing the computations with 
semi-simple elements below. 

A.B. Some application. Recall that, in order to prove Lemmas E6, E7 and E8, we had 
introduced the following property: 

(^G 0/ M 0/ z,n) If s is a semisimple element of (Mo/Z)* which is quasi-isolated in (Mo/Z)* and 
in (Go/Z)*, there exists an element z G Z((Mo/Z)*)° of order dividing n such that s 
and sz are not conjugate in (Go/Z)*. 

The aim of this subsection is to show how to use the CHEVIE package to check the 
following lemma: 

Lemma A.l. Assume that one of the following holds: 

(1) Go is of type Mo is of type A2 x A2, Z = 1 and n = 3. 

(2) Go is of type E7, Mo is of type E&, Z = Z(Go) and n = 4. 

(3) Go is of type E7, Mo is of type A\ x Ai x Ai as in diagram (EzfAj]*), Z = 1 and 
n G {4,6}. 

(4) Go is of type Eg, Mo is of type E7, Z = 1 and n G {3,5}. 

(5) Go is of type Eg, Mo is of type Eg, Z = 1 and n = 2. 

Then y Go 

Mo,z,n holds. 

Proof Note that in cases (1), (3), (4), (5), (Go/Z)* is the adjoint group of type E„, while 
in case (2) it is the semi-simple simply connected group of type E7. 

In what follows, to simplify notations, we will set G = (Go/Z)* and M = (Mo/Z)*. 
We show the complete computation corresponding to case (1). The other cases are 
treated by completely similar code, excepted that in case (2), the group should be defined 
via G:=CoxeterGroup("E" ,7, "sc") ;. 
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We want to show that for any s which is quasi-isolated in M of type Ai x Ai and G 
of type there is an element of order 3 of Z(M) which is not conjugate to s. 

We first compute the list of elements of order 3 of Z(M). The first thing is to specify 
M. 

gap> G:=CoxeterGroup("E" ,6) ; ;PrintDiagram(G) ; 
E6 2 
I 

1-3-4-5-6 

gap> M:=Ref lectionSubgroup(G, [1,3,5,6] ) ; 

Ref lectionSubgroup(CoxeterGroup("E" ,6) , [ 1, 3, 5, 6 ]) 

In GAP, the result of a command which ends with a double semicolon is not printed. The 
command PrintDiagram shows the numbering of the simple roots. 
We now compute the torus Z(M)° = Z(M). 

gap> ZM : =AlgebraicCentre (M) . Z0 ; 

[[0,1, 0, -1, 0, ] , [ 0, 0, 0, 1, 0, ] ] 

The torus Z(M)° is represented by giving a basis of Y(Z(M)°) inside Y(T). 
We now ask for the subgroup of elements of order 3 of Z(M)°. 

gap> Z3:=SemisimpleSubgroup(G,ZM,3) ; 
Group( <0, 1/3,0, 2/3, 0,0>, <0 , , , 1/3 , , 0> ) 

This group is represented as a subgroup of T; elements of T, which is of dimension 
6, are represented as lists of 6 elements of Q/Z in angle brackets; elements of Q/Z are 
themselves represented as fractions r such that ^ r < 1. The subgroup of elements of 
order 3 of Z(M)° is generated by 2 elements which are given above. We may ask for the 
list of all elements of this group. 

gap> Z3 : =Elements (Z3) ; 

[ <0,0,0,0,0,0>, <0,0,0,l/3,0,0>, <0,0,0,2/3,0,0>, <0 , 1/3 , , 2/3 , , 0> , 

<0,l/3,0,0,0,0>, <0, 1/3,0, 1/3, 0,0>, <0 , 2/3 , , 1/3 , , 0> , <0 , 2/3 , , 2/3 , , 0> , 
<0,2/3,0,0,0,0> ] 

We now compute the list of elements quasi-isolated in both G and M. 
gap> reps : =QuasiIsolatedRepresentatives (G) ; 

[ <0,0,0,0,0,0>, <0, 0,0,0, 1/2, 0>, <0, 0,0, 1/3,0,0, <0 , 1/6 , 1/6 , , 1/6 , 0> , 
<l/3,0,0,0,0,l/3> ] 

The list reps now contains representatives of G-orbits of quasi-isolated elements. The 
algorithm to get these was described in [4j. To get all the quasi-isolated elements in T, 
we need to take the orbits under the Weyl group: 
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gap> qi : =List (reps , s->0rbit (G , s) ) ; ; 
gap> List (qi, Length) ; 
[ 1, 36, 80, 1080, 90 ] 

We have not displayed the orbits since they are quite large: the first orbit is that of the 
identity element, which is trivial, but the fourth contains 1080 elements. We now filter 
each orbit by the condition to be quasi-isolated also in M. 

gap> qi : =List (qi ,x->Filtered(x,y->IsQuasiIsolated(M,y) ) ) ; ; 
gap> List (qi, Length) ; 
[ 1, 3, 26, 36, 12 ] 
gap> qi [2] ; 

[ <0,0,0,l/2,0,0>, <0, 1/2,0, 1/2, 0,0>, <0 , 1/2 , , , , 0> ] 

There is a way to do the same computation which does not need to compute the large 
intermediate orbits under the Weyl group of G. The idea is to compute first the orbit of 
a semi-simple quasi-isolated representative s under representatives of the double cosets 
Cg(s)\G/M, which are not too many, then test for being quasi-isolated in M, and 
finally take the orbits under the Weyl group of M. So starting with reps as above, we 
first compute: 

ce:=List(reps,s->SemisimpleCentralizer(G,s)) ; ;ce[5] ; 

Extended (Ref lectionSubgroup(CoxeterGroup("E" ,6) , [ 2, 3, 4, 5 ] ) ,<(2,5,3)>) 
gap> ce[5] .group; 

ReflectionSubgroup(CoxeterGroup("E" ,6) , [2, 3, 4, 5 ]) 
gap> ce [5] . permauts ; 

Group( ( 1,72, 6)( 2, 5, 3) ( 7,71,11)( 8,10, 9) (12,70, 16) (13, 14, 15) (17,68,21) 
(18,69,20) (22,66,25) (23,67,65) (26,63,28) (27,64,62) (29,59,31) (30,61,58) 
(32,57,53) (33,56,54) (34,52,48) (35,47,43) (36,42,37) (38,41,39) (44,46,45) 
(49,50,51) ) 

The first command above computes the groups Cq(s), which are possibly discon- 
nected groups. We show for the 5th element of reps how such a group is represented: 
it contains a reflection subgroup of the Weyl group of G, the Weyl group of C G (s), 
obtained above as ce [5] . group, extended by the group of diagram automorphisms in- 
duced on it by Cg(s), obtained above as ce[5] .permauts; these automorphisms are 
denoted by the permutation of the simple roots of C G (s) they induce. 

To get the whole Weyl group of Cg(s) we need to combine these two pieces. For this 
we define a GAP function: 

TotalGroup : =g->Subgroup (G, Concatenation (g. group . generators ,g. permauts .generators) ) ; 

We then compute representatives of the double cosets Cg(s)\G/M, we apply them 
to reps, keep the ones still quasi-simple in M: 

dreps:=List(ce,g->List(DoubleCosets(G, TotalGroup (g) ,M) , Representative) ) ; ; 
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qi : =List ( [1 . . Length (reps)] , i->List (dreps [i] , w->reps [i] ~w) ) ; ; 
qi : =List (qi ,x->Filtered(x,y->IsQuasiIsolated(M,y) ) ) ; 

[ [ <0,0,0,0,0,0> ], [ <0, 1/2,0,0,0,0, <0, 0,0, 1/2,0,0, <0, 1/2, 0, 1/2, 0, ], 
[ <0, 0,0, 1/3,0,0, <0, 0,0, 2/3,0,0, <l/3, 2/3, 1/3, 0,2/3, 2/3>, 

<l/3, 1/3, 1/3,0, 2/3, 2/3> ], 
[ <l/3,l/2,l/3,l/2,2/3,2/3>, <l/3, 1/2 , 1/3,0 , 2/3, 2/3> , 

<2/3, 0,2/3, 5/6, 2/3, 2/3> ], [ <l/3,0 , 1/3,0 , 1/3, l/3> ] ] 

We get a list such that the M-orbits of the sublists give the same list as before. We 
will need this previous list of all G-conjugates which are M-quasi-isolated, so if we did 
not keep it we recompute this list containing the M-orbits of the sublists by 

qim:=List(qi,l->Union(List(l,s->Orbit(M,s)))) ; ; 

We now ask, for each element s of each our orbits, how many elements z of Z3 are such 
that s and sz are not G-conjugate. The test for being conjugate is that sz is in the same 
G-orbit. We need to make the test only for our representatives of the M-orbits, since if s 
is G-conjugate to sz with z G Z(M), then msmr 1 is G-conjugate to msm~ l z = mszmr 1 . 

gap> List ( [1 . . Length (qi)] , i->List (qi [i] , s->Number (Z3, 

z->PositionProperty (qim, o->s*z in o)<>i))); 
[ [ 8 ], [ 8, 8, 8 ], [ 7, 7, 3, 3 ], [ 6, 6, 6 ], [ 6 ] ] 

and we find indeed that there is always more than elements z which work. Note that 
the function PositionProperty returns false when no element is found satisfying the 
given property, thus the number counted is the z such that s and sz are in a different 
orbit, as well as the cases when sz is not quasi-isolated in G. □ 

A.C. Rational structures. We now show the CHEVIE code for the following lemma. Here 
again to simplify notations we note G for (Gq/Z)* and M for (Mo)*. We are going to 
show the CHEVIE code to prove the following lemma: 

Lemma A.2. If G is adjoint of type E7, ifM is of type Ai x A] x Ai as in diagram (E/[Aj] # ), 
if q G {3,5} and ifXz(M),F = ^>i^>2 w ^ rl a ,b ^l, then Z(M) F contains an element of order 8. 

In CHEVIE, to specify an ¥ q -structure on a reductive group, we must in addition give 
an element cp G GL(Y(T)) such that F = qcp. We may chose cp such that it stabilizes the 
set of simple roots. Such an element cp is determined by the coset Wcp C GL(Y(T)), so 
the structure which represents it in CHEVIE is called a Coxeter coset. 

Further, if M' is an F-stable G-conjugate of the Levi subgroup M, the pair (M',F) 
is isomorphic to (M, wF) for some w G W (determined by M' up to F-conjugacy). So, 
given a Coxeter coset W(p, an F-stable conjugate of a Levi subgroup whose Weyl group 
is a standard parabolic subgroup Wj is represented by a subcoset of the form Wiwcp, 
where wcp normalizes Wj. 
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To check the lemma, we first compute the list of elements of order 8 of Z(M), using 
the same commands as shown before. 

gap> G:=CoxeterGroup("E" ,7) ; ;PrintDiagram(G) ; 
E7 2 
I 

1 _ 3 _ 4 _ 5 _ 6 - 7 

gap> M:=ReflectionSubgroup(G, [2,5,7] ); ; 

gap> ZM:=AlgebraicCentre(M) ; ; 

gap> Z8 : =SemisimpleSubgroup (G , ZM . ZO , 8) ; 

Group( <l/8,0,0,0,0,0,0>, <0,0, 1/8,7/8,0, 1/8, 0> , <0 , , , 1/8 , , 7/8 , 0> , 

<0,0,0,0,0,l/8,0> ) 

gap> Z8 : =Elements (Z8) ; ; Length (Z8) ; 

4096 

We now ask for representatives of the G F -classes of F-stable G-conjugates of M. The 
group G is split, so (p is trivial. Thus an F-stable-conjugate of M is represented by a 
coset of the form Wjiv. We first ask for the list of all possible such twistings of M: 

gap> Mtwists:=Twistings(G,M) ; 

[ AK2>xAK5>xAK7>. (q-l)~4, (AlxAlxAl) <2 , 5 , 7> . (q-1) "2* (q~2+q+l) , 
AK2>xAK5>xAK7>. (q-1) "2* (q~2+q+l) , (AlxAlxAl) <2 , 5 , 7> . (q~2+q+l)~2, 
(AlxAlxAl)<2,7,5>. (q-1) * (q+D * (q~2+q+l) , 

(AlxAlxAl)<2,7,5>. (q-1) * (q+1) * (q~2-q+l) , (AlxAlxAl) <2 , 7 , 5> . (q+1) ~2* (q~2-q+l) 

, AK2>xAK5>xAK7> . (q+1) "2* (q~2-q+l) , 
(AlxAl)<2,7>xAl<5>. (q-l)*(q+D*(q~2+q+l) , 

(AlxAl)<2,7>xAl<5>. (q-1) * (q+1) * (q~2-q+l) , (AlxAlxAl) <2 , 7 , 5> . (q~2-q+l)~2, 
(AlxAlxAl)<2,5,7>. (q~4-q~2+l) , AK2>xAK5>xAK7> . (q+l)~4, 
AK2>xAK5>xAK7>. (q~2+l)~2, (AlxAl) <2 , 7>xAl<5> . (q~4+l) , 
AK2>xAK5>xAK7>. (q-1) ~2* (q+1) ~2 , (AlxAl) <2 , 7>xAl<5> . (q+1) ~2* (q~2+l) , 
(AlxAl) <2,7>xAl<5>. (q-1) ~2* (q~2+l) , AK2>xAK5>xAK7> . (q-1) * (q+1) * (q~2+l) , 
(AlxAl)<2,7>xAl<5>. (q-1) * (q+1) * (q~2+l) , (AlxAl) <2 , 7>xAl<5> . (q-1) "3* (q+1) , 
AK2>xAK5>xAK7>. (q-l)*(q+l)~3, AK2>xAK5>xAK7> . (q-1) "3* (q+1) , 
(AlxAl)<2,7>xAl<5>. (q-1) * (q+1) ^3 , (AlxAl) <2 , 7>xAl<5> . (q-1) "2* (q+1) "2 ] 

In the above list, brackets around pairs or triples of A\ denote an orbit of the Frobe- 
nius on the components. The element w is not displayed, but the order of |Z(M) wF | 
is displayed. We want to keep the sublist where that order is a product of ^>i(q) and 

gap> Mtwists : =Filtered(Mtwists ,MF->Set (PhiFactors (MF) ) = [-1 , 1] ) ; 

[ AK2>xAK5>xAK7>. (q+l)~4, AK2>xAK5>xAK7> . (q-1) ~2* (q+1) "2 , 

(AlxAl)<2,7>xAl<5>. (q-1) ^3*(q+l) , AK2>xAK5>xAK7> . (q-1) * (q+1) "3 , 
AK2>xAK5>xAK7>. (q-1) "3* (q+1) , (AlxAl) <2 , 7>xAl<5> . (q-1) * (q+1) "3 , 
(AlxAl)<2,7>xAl<5>. (q-1) ~2* (q+1) ~2 ] 
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Here PhiFactors gives the eigenvalues of w on the invariants of the Weyl group of 
M acting on the symmetric algebra of X(T) ® C. The cases we want is when these 
eigenvalues are all equal to 1 or —1 (actually this gives use one extra case, where 
|Z(M) a ' F | = (q + l) 4 since the eigenvalues on the complement of Z(M) are always 
1; we will just have to disregard the first entry of Mtwists). 

Now for each of the remaining Mtwists we compute the fixed points of zvF on Z8, 
and look at the maximal order of an element in there. We first illustrate the necessary 
commands one by one on an example before showing a line of code which combines 
them. 

gap> Z8F:=Filtered(Z8 , s->Frobenius (Mtwists [3] ) (s) ~3=s) ; 

[ <0,0,0,0,0,0,0>, <0,0,0, 1/4,0, 1/4, 0>, <0 , , , 1/2 , , 1/2 , 0> , 

<0, 0,0, 3/4,0, 3/4, 0>, <0,0, 1/2,0,0, 1/2, 0>, <0 , , 1/2 , 1/4 , , 3/4 , 0> , 
<0,0,l/2,l/2,0,0,0>, <0,0, 1/2,3/4,0, 1/4, 0>, <l/4 , , 1/4 , 1/8 , , 7/8 , 0> , 
<l/4,0, 1/4,3/8,0, 1/8, 0>, <l/4, 0,1/4, 5/8,0, 3/8, 0>, <l/4 , , 1/4 , 7/8 , , 5/8 , 0> , 
<l/4, 0,3/4, 1/8,0, 3/8, 0>, <l/4 , , 3/4 , 3/8 , , 5/8 , 0> , <l/4 , , 3/4 , 5/8 , , 7/8 , 0> , 
<l/4, 0,3/4, 7/8,0, 1/8, 0>, <l/2 , , , , , , 0> , <l/2, 0,0, 1/4,0, 1/4, 0>, 
<l/2,0,0, 1/2,0, 1/2, 0>, <l/2, 0,0, 3/4,0, 3/4, 0>, <l/2 , , 1/2 , , , 1/2 , 0> , 
<l/2,0, 1/2, 1/4,0, 3/4, 0>, <l/2,0,l/2,l/2,0,0,0>, <l/2 , , 1/2 , 3/4 , , 1/4 , 0> , 
<3/4,0, 1/4, 1/8,0, 7/8, 0>, <3/4 , , 1/4 , 3/8 , , 1/8 , 0> , <3/4 , , 1/4 , 5/8 , , 3/8 , 0> , 
<3/4, 0,1/4, 7/8,0, 5/8, 0>, <3/4 , , 3/4 , 1/8 , , 3/8 , 0> , <3/4 , , 3/4 , 3/8 , , 5/8 , 0> , 
<3/4, 0,3/4, 5/8,0, 7/8, 0>, <3/4 , , 3/4 , 7/8 , , 1/8 , 0> ] 

The expression Frobenius (Mtwists [3] ) returns a function which applies the w for the 
3rd twisting of M, described as (AlxAl)<2,7>xAl<5>. (q-1) ~3* (q+1), to its argument. 
To compute wF we still have to raise to the third power since q = 3. We can see from the 
denominators that some elements in the resulting list of o;F-stable elements of Z8 are of 
order 8. We can make this easier to see by writing a small function: 

gap> OrderSemisimple:=s->Lcm(List(s.v, Denominator)) ; 
gap> List(Z8F,0rderSemisimple) ; 

[ 1, 4, 2, 4, 2, 4, 2, 4, 8, 8, 8, 8, 8, 8, 8, 8, 2, 4, 2, 4, 2, 4, 2, 4, 8, 

8, 8, 8, 8, 8, 8, 8 ] 
gap> Set (last) ; 
[ 1, 2, 4, 8 ] 

We now do the computation simultaneously for all cosets: 

gap> List (Mtwists ,MF->Set (List (Filtered(Z8 , s->Frobenius (MF) (s) ~3=s) , 
> OrderSemisimple) ) ) ; 

[ [ 1, 2, 4 ], [1, 2, 4, 8 ], [ 1, 2, 4, 8 ], [ 1, 2, 4, 8 ], 
[ 1, 2, 4, 8 ] , [ 1, 2, 4, 8 ] , [ 1, 2, 4, 8 ] ] 

and we see that indeed, apart from the first twist which should be disregarded, for all 
twists the fixed points of Z8 still contain elements of order 8. 
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